TAUT REPRESENTATIONS OF COMPACT SIMPLE LIE GROUPS 



CLAUDIO GORODSKI 



Abstract. In this paper we classify the reducible representations of compact simple Lie 
groups all of whose orbits are tautly embedded in Euclidean space with respect to Z2 
coefficients. 



1. Introduction 

The main result of this paper is the following classification theorem. 

Theorem 1. A taut reducible representation of a compact simple Lie group is one of the 
following representations : 



SU(n), n > 3 


C" © • • • © C n 


k copies, where 1 < k < n 


SO(n), n>3,n^4 


R" © • • • © R n 


k copies, where 1 < k 


Sp(n), n > 1 


c 2n © • • • © C 2n 


k copies, where 1 < k 


G 2 


R Y © R Y 




Spin(6) 


R b ffiC 4 


R b = (vector), C 4 = (spin) 


Spin(7) 


R Y © R 8 
R 8 ffiR 8 
R 8 © R 8 © R 8 
R 7 © R 7 © R 8 


R 7 = (vector), R 8 = (spin) 


Spin(8) 


RgffiR^ 
Rq © Rg © R_|_ 

Rq © Rq © Rg © R_|_ 


Rg = (vector), K% = (halfspin) 


Spin(9) 


R ib © R ib 


R ib = (spin) 



A representation of a compact Lie group is called taut if all of its orbits are taut subman- 
ifolds of the representation space. Carter and West introduced in jCW72| the concept of 
tautness for submanifolds (see also |CR85j ). Fix a field of coefficients F (herein assumed to 
be Z 2 ). Let M be a properly embedded submanifold of an Euclidean space R m . For each 
p G R m , consider the squared distance function L p : M — > R given by L p (x) — \ \x — p\\ 2 . It 
is a consequence of the Morse index theorem that the critical points of L p are nondegenerate, 
i.e. L p is a Morse function, if and only if p is not a focal point of M. Now M is called F-taut, 
or simply taut, if L p is a perfect Morse function for every p in R m that is not a focal point 
of M. We recall that a Morse function is said to be perfect if the Morse inequalities are 
equalities for the function restricted to any sublevel set. As a consequence of the proof of 
the Morse inequalities, one sees that an equivalent definition of F-tautness for a submanifold 
M C R m is that the induced homomorphism 

H*(MnB;F)^H # (M; F) 

in singular homology is injective for almost every closed ball B in R m . It is then clear that 
tautness is conformally invariant. 
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A compact surface in R which is taut is either a round sphere or a cyclide of Dupin 
(see |Ban70p ; the latter can all be constructed as the image of a torus of revolution under 
a Mobius transformation. Pinkall and Thorbergsson found in [PTS9| the homeomorphism 
classes of the compact 3-dimensional manifolds that admit taut embeddings, and their list 
consists of seven manifolds. The first three are S 1 x S 2 and its quotients S 1 x RP 2 and 
S* 1 x Z2 S 2 . The next three are S 3 and its quotients RP 3 and S 3 /{±l,±i,±j,±k} (the so- 
called quaternion space). The last example is the torus T 3 . It follows from the Chern-Lashof 
theorem |CL57j that a taut substantial (namely, nor contained in an affine hyperplane) em- 
bedding of a sphere must be spherical and of codimension one. If M is an n-dimensional 
taut hypersurface in R n+1 which has the same integral homology as S k x S n ~ k , then Cecil 
and Ryan proved in |CR78j that M has precisely two principal curvatures at each point 
and that the principal curvatures are constant along the corresponding curvature distribu- 
tions. Bott and Samelson proved in |BS58j that the orbits of the isotropy representations 
of the symmetric spaces, sometimes called generalized flag manifolds, are tautly embedded 
submanifolds, although they did not use this terminology. The generalized flag manifolds 
are homogeneous examples of submanifolds which belong to another very important, more 
general class of submanifolds called isoparametric submanifolds. Hsiang, Palais and Terng 
studied in |HPT88j the topology of isoparametric submanifolds and proved, among other 
things, that they and their focal submanifolds are taut. 

Most of the examples of taut embeddings known are homogeneous spaces. In jTho88 
Thorbergsson posed some questions regarding the problem of which homogeneous spaces 
admit taut embeddings and derived some necessary topological conditions for the existence 
of a taut embedding which allowed him to conclude that certain homogeneous spaces cannot 
be tautly embedded (see also Heb88 ), among others the lens spaces distinct from the real 
projective space. Many proofs have been given of the tautness of special cases of generalized 
flag manifolds where the arguments are easier. No new examples of taut embeddings of 
homogeneous spaces besides the generalized flag manifolds were known until Gorodski and 
Thorbergsson classified in GT03J (see also |GTj ) the irreducible representations of compact 
Lie groups all of whose orbits are tautly embedded; we call representations with this prop- 
erty taut. It turns out that the classification includes three new representations which are 
not isotropy representations of symmetric spaces, thereby supplying many new examples 
of tautly embedded homogeneous spaces. In |GT02j Gorodski and Thorbergsson provided 
another proof of the tautness of those orbits by adapting the proof of Bott and Samelson 
to that case. It is interesting to remark that those three representations precisely coincide 
with the representations of cohomogeneity three of the compact Lie groups which are not 
orbit equivalent to the isotropy representation of a symmetric space. (Recall that two repre- 
sentations are said to be orbit equivalent if there is an isometry between the representation 
spaces mapping the orbits of the first representation onto the orbits of the second one.) As 
mentioned above, in this paper we extend the classification in [G T03j to the case in which 
the representation is reducible and the group is simple. 

The author would like to thank Professor Gudlaugur Thorbergsson for useful discussions, 
and FAPESP and CNPq for financial support. 



2. Preliminary material 



In this section, we collect results that will be used later to prove that certain representa- 
tions are or are not taut. We start with a following simple remark, namely, every summand 
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of a taut reducible representation is taut. Indeed, this is because an orbit of a summand 
is also an orbit of the sum, and it implies that taut reducible representations are sums of 
taut irreducible ones. So, in order to classify taut reducible representations, we need just to 
decide which of those sums are allowed. We shall do that for simple groups. 
We begin by recalling the main result of [GT03J. 

Theorem 2 ( GT03J). A taut irreducible representation of a compact connected Lie group 
is either orbit equivalent to the isotropy representation of a symmetric space or it is one of 
the following orthogonal representations (n > 2): 

SO(2) x Spin(9) I (vector) ® R (spin) 
U(2) x Sp(ra) (vector) ® c (vector) 
SU(2) x Sp(n) (vector) 3 ® H (vector) 

Since the groups appearing in the table of Theorem |21 are nonsimple, now we can refine 
the remark above and state that every summand of a taut reducible representation is orbit 
equivalent to the isotropy representation of a symmetric space. Throughout the paper, we 
shall make use of the tables of isotropy representations of a symmetric spaces given in [Wol84j. 
The irreducible representations orbit equivalent to the isotropy representation of a symmetric 
space are also classified (see |EH99j ). Lists with some of the principal isotropy subgroups of 
these representations can be found in [HPT88] IStr96j . 

The fundamental result about taut sums of representations is: 

Proposition 1 QGT03 ). Let pi and p 2 be representations of a compact connected Lie group 
G on V\ and V 2 , respectively. Assume that p% © p 2 is F-taut. Then the restriction of p 2 to 
the isotropy group G Vl is taut for every V\ £ V\. Furthermore, we have that p(G(vi,v 2 ); F) = 
p(Gvi, F) p(G Vl v 2 ; F), where p(M; F) denotes the Poincare polynomial of M with respect to 
the field F. In particular, G Vl v 2 is connected and bi(G(vi, v 2 ); F) = b\(Gv\; F)+bi(G Vl v 2 ; F), 
where bi(M; F) denotes the first Betti number of M with respect to F. 

We give examples of how Proposition ^ can be used. These are taken from |GT| . 

Examples 1. (i) Let G = SO(n) and let p\ be the SO(n)-conjugation on the space V\ of 
real traceless symmetric nxn matrices. Then pi is taut since it is the isotropy representation 
of the symmetric space SL(n, R)/SO(n). Let p 2 be any other nontrivial representation of 
SO(n) with representation space V 2 . Then p\ © p 2 cannot be taut if n > 3. To see this, 
let v\ £ V\ be a regular point. Then G Vl is the discrete group consisting of all diagonal 
matrices with determinant one and entries ±1 on the diagonal. The kernel of p 2 is contained 
in the center of SO(n). Since n > 3, we see that G Vl cannot be contained in the kernel 
of p 2 . Hence there is an element v 2 £ V 2 that is not fixed by G Vl . It follows that G Vl v 2 is 
disconnected. Now Proposition[T]implies that pi®p 2 is not taut. The same argument applies 
more generally whenever p\ is a taut representation of a compact connected Lie group G 
such that its principal isotropy subgroup is discrete and not central. 

(ii) Now let G be a compact connected simple Lie group of rank at least two and let p\ 
denote the adjoint representation of G. We assume that G is simply connected. Let p 2 
be any other nontrivial representation of G. Then p\ © p 2 is not taut. To see this let T 
be a maximal torus in G. We denote the representation spaces of p\ and p 2 by V\ and V 2 
respectively. There is a regular element v\ £ V\ with G V1 = T. The restriction of p 2 to T 
has a discrete kernel that is contained in the center of G. If v 2 £ V 2 is a T-regular point then 
the isotropy subgroup T V2 coincides with the kernel of p 2 \T. Hence G vi v 2 is diffeomorphic to 
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T and it follows that bi(G Vl v 2 ] F) is equal to the rank of G. In particular bi(G n v 2 ; F) > 2. 
Now notice that the isotropy group of (t>i,t>2) is also T V2 . Hence iri(G(v i, v 2 )) = T V2 which 
implies Hi(G(v\, v 2 ); Z) = T V2 since T V2 is Abelian. If G 7^ Spin(4A;) then the center of G is a 
cyclic group and it follows that bi(G(vi, v 2 ); F) < 1. If G = Spin(4A;), then k > 2 and we get 
bi(G Vl v 2 ; F) = 2k > 4; since the center of Spin(4A;) is Z 2 x Z 2 , we have &i(G(t> 1, u 2 ); F) < 2. 
In either case, 61 (G vi v 2 ; F) > bi(G(vi,v 2 ); F) which implies by Proposition [T] that p\ © p 2 is 
not taut. 

Recall that the slice representation of a representation p : G — > 0{V) at a point V 
is the representation induced by the isotropy G p on the normal space to the orbit Gp at p. 
The following result often works as a kind of induction. 

Proposition 2 ( GT03 ). Let p : G — > O(V) fre a taut representation of a compact connected 
Lie group G. Then the slice representation of p at any p G V is taut. 

We now discuss a reduction principle which in many cases considerably simplifies the 
problem of deciding whether a representation is taut or not. Let p : G — > O(V) be a 
representation of a compact Lie group G which is not assumed to be connected. Denote by 
H a fixed principal isotropy subgroup of the G-action on V and let V H be the subspace of 
V that is left pointwise fixed by the action of H. Let iV be the normalizer of H in G. Then 
the group N = N/H acts on V H with trivial principal isotropy subgroup. Moreover, the 
following result is known ( [USOOl ILunfrU 0731 EcEM ISS951 ITOij ) : 

Theorem 3 (Luna- Richardson). The inclusion V H — * V" induces a stratification preserving 
homeomorphism between orbit spaces 

V H /N -> V/G. 

The relation to tautness is expressed by the following result. 

Proposition 3 ( GT03 ). Suppose there is a subgroup L C H which is a finitely iterated 
Z 2 -extension of the identity and such that the fixed point sets V L = V H . Suppose also that 
the reduced representation p : N° — > 0(V ) is Z 2 -taut, where N° denotes the connected 
component of the identity of N. Then p : G — > 0(V) is Z 2 -taut. 

We close this section with some very useful remarks. 

Remark 1. (a) It follows from the discussion of Kuiper in |Kui61j that if M is a taut 
substantial submanifold of an Euclidean space, then there exists p G M such that the 
image of the second fundamental form of M at p spans the normal space of M at p. 
As a corollary, the codimension of M is at most n(n + l)/2, where n = dimM. 
(b) One defines a submanifold of an Euclidean space to be F-tight, or simply tight, simi- 
larly as was done for tautness, except that one replaces distance functions by height 
functions h^(x) = (x, £), £ a nonzero vector. It turns out that tightness is invariant 
under linear transformations, and a taut sumanifold of an Euclidean space is tight. 
Moreover, a tight submanifold of an Euclidean space which is contained in a round 
sphere is taut, and in this situation the set of critical points of a distance function 
will also occur as the set of critical points of a height function (see iC R85| lPT88j ). 



Ozawa proved in [OzaS6] that the set of critical points of a distance function of a 
taut submanifold decomposes into critical submanifolds which are nondegenerate in 
the sense of Bott; it follows that the so called Morse-Bott inequalities are equalities 
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for the function restricted to any sublevel set; namely, the number of critical points 
of the function is equal to the sum of the Betti numbers of the critical submanifolds, 
see |Bot54j . 



3. The classification 

Let p : G — > O(V) be a taut reducible representation where G is a compact connected 
simple Lie group. Of course we may assume that p does not contain trivial summands. Write 
P = Pi©P2, where p\ is irreducible. Then p\ is orbit equivalent to the isotropy representation 
of an irreducible symmetric space. We first prove a lemma for later use, and then we shall run 
through all the possibilities for G and p\, where we find it convenient to consider separately 
the cases G = Spin(n) and G = SO(n). 

Lemma 1. The following representations are not taut: 

(a) S 1 x S 1 -> U(l) x U(l) x U(l) given by (e ta ,e il3 ) i-> (e ia , e i/3 , e i( - a+ ®). 
(6) Sp(l) x Sp(l) -> SO(4) x SO(4) x SO(4) given by (p,q) i-> (l p ,r q ,l p rq), where l x 
(resp. r x ) denotes left (resp. right) translation by the unit quaternion x. 

Proof. We will prove (a); assertion (b) is similar. Let M denote the orbit through p = 
(1,1,1) G C © C © C. We will show that M is not taut by exhibiting a height function which 
is not perfect, see Remark ^b). The normal space v v M is easily seen to be spanned over R 
by (1, 0, 0), (0, 1, 0), (0, 0, 1) and (i, i, —i). Let h : M — > R be the height function defined by 
p. Note that gp, g G S 1 x S 1 , is a critical point of h if and only if p G v gp M, or, equivalently, 
g~ x p G v p M. One immediately computes that g = (±1,±1) or (— ~ ± — | ±z^), so 
there are 6 critical points. Since M is a 2-torus, h is not perfect. □ 

3.1. The case G = SO(ra), n = 3 or n > 5. Here p\ is one of the following: 

(a) the vector representation on R"; 

(b) the adjoint representation on A 2 R n , where n > 5; 

(c) the representation on the space of traceless symmetric matrices SqTV 1 ; 

The possibilities (b) and (c) are ruled out by Examples [TJ Now possibility (a) is taken care 
of by the following proposition (compare |TT97j . Examples 3.14). 

Proposition 4. Assume that n > 3 and p is the sum of k > 1 copies of the vector represen- 
tation. Then p is taut. 

Proof. Let V = R n © ■ • • © R n , k copies. Suppose first that k < n. Let {ei, . . . , e n } 
be the canonical basis of R n , and let p = (ei, . . . , e^) G V. View V as the space of real 
n x /c-matrices, and let G = SO(n) x SO(fc) act on V by (A, i?) ■ X = AXB' 1 , where 
(A, B) G G and X G V". Then = Gp. Since (G, l 7 ) is the isotropy representation of 
the Grassmann manifold Gfc(R n+fc ), we have that Gp is taut. Next suppose that k > n and 
let q = (vi, . . . ,Vk) G V be an arbitrary nonzero point. Then there is a nonsingular k x k 
matrix M such that right-multiplying q by M gives gM = (ei, . . . , ei, 0, . . . , 0) G V, where 
1 < I < n. It follows from the above that G(qM) = (Gq)M is taut. Since a taut submanifold 
in Euclidean space is tight, and tightness is invariant under linear transformations, Gq is 
tight. But Gq lies in a sphere, and so it is taut. This completes the proof that p is taut. □ 
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3.2. The case G = SU(n), n = 3 or n > 5. Here pi is one of the following: 

(a) the vector representation on C n ; 

(b) the adjoint representation on su(n); 

(c) a real form of the representation of SU(8) on A 4 C 8 . 

(d) the representation on the space of skew-symmetric matrices A 2 C p+ , where p > 2; 

The possibilities (b) (even if n — 4) and (c) are ruled out by Examples GJ Consider the 
possibility (d). Here a principal isotropy subgroup H is given by p diagonal blocks, each 
isomorphic to SU(2). Denote the representation spaces of p\ and p 2 by V\ and V 2 . Now 
there exists V\ G Vj. such that G„ 1 = H = SU(2) P . We can assume that p 2 is irreducible. 
If pi is the vector representation, then we can find v 2 G V2 such that iff 2 ~ 5* 3 x ■ ■ ■ x S 3 , 
p factors. In this case G(t>i,t> 2 ) ~ SU(2p+ 1); since the third Betti number of a compact 
connected simple Lie group is 1, p cannot be taut by Proposition [T] If p 2 is also as in (d), it 
is not difficult to see that p%\G Vl contains as a summand a representation equivalent to that 
in Lemma Gib), and thus p cannot be taut by Proposition ^ This shows that p is not taut 
if p\ is as in (d). Now (a) is covered by the following proposition. 

Proposition 5. Assume thatn > 3 and p is the sum of k copies of the vector representation. 
If 1 < k < 11, then p is taut. If k > n, then p is not taut. 

Proof. In the case 1 < k < n, we need to know that the isotropy representation of the 
Grassmann manifold Gk(C n+h ) is S(U(n) x U(/c)) acting on the space of complex n x k 
matrices, and it is orbit equivalent to its restriction to the subgroup SU(n) x SU(fc) if k 7^ n 
(see [EH99J). It follows as in Proposition 0] that p is taut. In the case k > n, it is enough 
to consider k — n. Let {ei, . . . ,e n } be the canonical basis of C n . The isotropy subgroup 
at ei is isomorphic to SU(n — 1), and the slice representation at e\ decomposes into a sum 
of trivial representations and C n_1 © • • • © C n_1 , n — 1 copies. We use Proposition |21 and 
induction to reduce to the case of SU(3) acting on C 3 © C 3 © C 3 . Let p = (ei, e 2 , e 3 ), and 
denote by M the SU(3)-orbit through p. Then M is the standard inclusion of SU(3) into 
the space M(3, C) of complex 3 x 3-matrices. The tangent space T P M is the Lie algebra 
su(3), and the normal space v v M is Cp © zsu(3). By Remark [Tfb), it suffices to show that 
a height function is not perfect. Let h : M — > R be the height function defined by p. We 
find the critical points of h. Note that gp, for g G SU(3), is a critical point of h if and only 
if p G Vg P M, or, what amounts to the same, g~ 1 p G v v M. Now it is easy to see that gp is a 
critical point of h if and only if g = 00I, where uj is a cubic root of unity and I is the identity 
matrix, or g is conjugate to a diagonal matrix with entries — 1, —1 and 1. It follows that 
the critical set of h consists of 3 isolated points and a submanifold diffeomorphic to CP 2 , 
whence the sum of its Betti numbers is 6. Since SU(3) has the homology of S 3 x S 5 , h is 
not perfect in the sense of Bott, see Remark G^c). □ 

3.3. The case G = Sp(ra), n > 3. Here pi is one of the following: 

(a) the vector representation on C 2ra ; 
{b) the adjoint representation on Sp(n); 

1 

(c) a real form of the 42-dimensional representation • — • — • — o of Sp(4). 

(d) a real form of the representation A 2 C 2n — C; 

The possibilities (b) (even if n — 2) and (c) are ruled out by Examples GJ Consider the 
possibility (d). Here a principal isotropy subgroup H is given by the diagonal embedding of 
Sp(l) n into Sp(n), so there exists V\ G V\ such that G Vl = H = Sp(l) n . We can assume 
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that P2 is irreducible, and then p2 is as in (a) or in (d). If P2 is as in (a), the proof follows 
as in section l3~2l to deduce that p is not taut. If pi is as in (d), Proposition |B] below implies 
that p is not taut. 

Proposition 6. Let V n denote a real form of the representation A 2 C 2n — C o/Sp(n), where 
n > 3. Then (Sp(n), © V n ) zs noi iaui. 

We postpone the proof of Proposition |H1 to the end of the paper since the methods used 
to prove it better belong there. Finally, (a) is covered by 

Proposition 7. Assume that n > 1 and p is the sum of k > 1 copies of the vector represen- 
tation. Then p is taut. 

Proof. The proof is analogous to the proof of Proposition 0] □ 

3.4. The case G is exceptional. First note that no summand of p can be the adjoint 
representation by Example ^ii). 

If G — G2, then p is the sum of k copies of the 7-dimensional representation. If k — 2, 
p is orbit equivalent to (SO(7),R 7 © R 7 ) (which is taut). If k — 3, p is not taut because 
a principal orbit is diffeomorphic to G2 and thus has the homology of S 3 x S 11 , but an 
application of Proposition [T] would require it to have the homology of S 6 x S 5 x S 3 in case 
it was taut. 

If G = F 4 , then p is the sum of k copies of the 2 6- dimensional representation. Suppose 
k = 2, p = pi © pi- Then there is an isotropy subgroup H of p\ isomorphic to Spin (9). Now 
P2\H decomposes as R©R 9 ©R 16 , and it is not taut by Proposition IT7I Hence p is not taut 
by Proposition [T] 

Eg, E7 and E§ do not admit representations orbit equivalent to the isotropy representation 
of a symmetric space. 

3.5. The case G = Spin(n), n = 3 or n > 5. This is case is more involved than the previous 
ones. In view of section 13.11 we may assume that a summand of p is a spin representation. 
Now the only values of n which need to be considered are 3, 5, 6, 7, 8, 9, 10 and 16. 

3.5.1. G = Spin(3). Here G = SU(2) = Sp(l). By the discussion in section I3~T1 the admis- 
sible summands of p are the vector representation of SU(2) on C 2 and the representation 
on R 3 given by SU(2) — > SO (3). The sum of an arbitrary number of copies of C 2 is taut by 
Proposition [7| On the other hand, C 2 ©R 3 is not taut, because the principal orbit through a 
point (a, b) G C 2 ©R 3 with a, b 7^ is substantial and diffeomorphic to S 3 , but, as mentioned 
in the introduction, a sphere can be taut only in substantial codimension one. 

3.5.2. G = Spin(5). Here G = Sp(2). By the discussion in section l3~Tl the admissible 
summands of p are the vector representation of Sp(2) on C 4 and the representation on 
R 5 given by Sp(2) — > SO (5). The situation in which R 5 is not present is covered by 
Proposition [7| On the other hand, we have 

Proposition 8. C 4 © R 5 is not taut. 

Proof. Note that the principal orbits are substantial embeddings of Sp(2) in S 12 . We will 
show that Sp(2) can admit a taut substantial embedding of codimension 2 in a sphere S N 
only if N = 15 following an argument which appeared in |Gal93j . p. 75. 

So suppose that X is diffeomorphic to Sp(2) and tautly embedded in S with iV > 12. 
Let Y be a sufficiently small tubular neighborhood of X in S . X has the homology of 
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S 3 x S 7 , so its homology groups vanish except in dimensions 0, 3, 7 and 10. Since 2x3^7, 
it follows as in Proposition 2.2 of |Oza86| that Y is a compact proper Dupin hypersurface. 
Moreover, a Morse distance function on Y can have critical points of index 0, 3, 7 and 10 
only. By the Morse index theorem, the multiplicities of the first three principal curvatures of 
Y are m\ = 3, m 2 = 4 and m 3 = 3. According to Theorem C in (iIH)l . there exists at most 
2 different multiplicities k, I, and g = 2 or 4 in case k ^ I. Therefore the fourth principal 
curvature of Y has multiplicity m 4 = 4. It follows that dim!" = 14, and hence, N = 15. □ 

3.5.3. G = Spin(6). Here G = SU(4). By the discussion in section I3~T1 the admissible 
summands of p are the vector representation of SU(4) on C 4 and the representation on 
R 6 given by SU(4) — > SO(6). The situation in which R 6 is not present is covered by 
Proposition Also, C 4 © R 6 is taut because the singular orbits are round spheres in C 4 
and R 6 , and the principal orbits are products of those. The following two propositions settle 
down this case. 

Proposition 9. C 4 © R 6 © R 6 is not taut. 

Proof. Let p G R 6 . Then the slice representation at p is Spin(5) = Sp(2) acting on 
R © R © C 4 © R 5 . The result follows from Propositions H and El □ 

Proposition 10. C 4 © C 4 © R 6 is not taut. 

Proof. We will show that a certain orbit is not taut by finding an explicit height function 
which is not perfect. We need to have a good parametrization of the orbits. It is useful to 
use Cayley numbers. Recall that the Cayley algebra can be viewed as Ca = H © He via 
the Cayley-Dickson process, where H = R(l, i,j, k) is the quaternion algebra (see appendix 
IV. A in [HL82J). Then Ca = R(l, k, e, ie,je, ke). According to [CR98J, upon identifying 
Ca = R 8 and using Cayley multiplication, 

Spin(8) = {(A, B, C) G SO(8) x SO(8) x SO(8) : Afa) = B(^)C(ij), for all £, rj G Ca}, 

Spin(7) = {(A,B,C) G Spin(8) : A{1) = 1}, 
= {(A,B,C) G Spin(8) : C = B}, 

where B(x) = B(x), and 

Spin(6) = {(A, B, B) G Spin(7) : A{i) = i}. 

Also, the isomorphism Spin(6) — > SU(4) is given by (A, B, B) \— > B, and the projection 
Spin(6) — > SO(6) is given by (A,B,B) — > A. Therefore the covering ip : SU(4) — > SO(6) 
is given by ip(g)(x) = g(x)g(l) = g(l)g(x), where g G SU(4) and x G R 6 . Here we 
regard SU(4) as the subgroup of SO(8) defined by the complex structure in R 8 given by 
left multiplication by the element i. This identifies Ca = C 4 . Now (note that i{ke) = je) 
C 4 = C(l, j, e, ke), R a = R(j, k, e, ie,je, ke). 

Fix the base point p = (l,j,e) G V = C 4 © C 4 © R 6 . Let G = SU(4) act on V. 
Then G p is trivial. Let M = Gp, principal orbit diffeomorphic to SU(4). M can also be 
parametrized by the Stiefel manifold S^C 4 ). In fact, given (^1,^2,^3) G S , t 3 (C 4 ), there is 
a unique g G SU(4) such that g^il) = z±, g^U) = z 2, an d fl ,_1 ( e ) = z 3- Then we get 
^7 1 ( 1 , j, e) = (zi, z 2 , Z3Z1) G M. View p = (l,j, e) as a vector in u p M, and let h : M — > R 
be the height function defined by p. We have that gp G M, g G SU(4), is a critical point of 
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h if and only if p G v p M. It is easy to compute that the normal space to M at p = e) 
is spanned by 

(1,0,0), (0,j,0), (0,0, e), (j,l,0), (k, —i, 0), (je,e,j), (ke,-ie,k). 

Now the condition that g~ 1 p G z/ p M is that there exist A, B, C, D, E, F, G G R such that 

(zi, 2 2 , z 3 fi) = (A + Dj + + Fje + Gfce, D — Ei + Bj + Fe — Gie, Fj + Gk + Ce). 

The relations (zj, £j) = d>y, where (■, ■) denotes the Hermitian inner product in C 4 , yield the 
following relations: 

(A + B)(D + Ei) = 0, 

(F -Gi)(AB + BC + AC - F 2 -G 2 - D 2 - E 2 ) = 0, 

A 2 + D 2 + E 2 + F 2 + G 2 = 1, 

A 2 -B 2 = 0, 

C 2 + F 2 + G 2 = 1. 

The system admits the following solutions: 

• A = B = -C = ±1, D = E = F = G = 0; 
. A = B = C = ±1, D = E = F = G = 0; 

• A = B = C = ±i, D = E = 0, F 2 + G 2 = f ; 

• A = C = ±1, F = G = 0, A 2 + £> 2 + E 2 = 1. 

Since i— > is a well defined homeomorphism of M, we deduce that the critical set of h 
consists of 4 points, 2 circles and 2 spheres. Now the sum of the Betti numbers of the critical 
manifolds of h is 12. Since SU(4) has the homology of S 3 x S 5 x S* 7 , M is not taut. □ 

3.6. G = Spin(7). By the discussion in section I3~T1 the admissible summands of p are the 
vector representation on R 7 and the spin representation on R 8 . We first note that R 8 © R 7 
is taut because the singular orbits are round spheres in R 8 and R , and the principal orbits 
are products of those. Moreover, R 8 © R 8 and R 8 © R 8 © R 8 are taut because Spin(7) is 
transitive on the Stiefel manifolds St2 (R 8 ) and Sts (R 8 ), so the actions of Spin(7) on these 
spaces are orbit equivalent to the actions of SO (8). We also note that if p has 4 summands 
and R 8 is one of them, say Vi, then the slice representation at a point in V\ is G 2 acting 
on R 7 © R 7 © R 7 , which is not taut by the discussion in section I3~4l hence, p is not taut by 
Proposition El We finish this case with the following two propositions. 

Proposition 11. R 7 © R 7 © R 8 is taut. 

Proof. We shall use the reduction principle as described in Proposition El In order to 
have a good description of the representation, we resort to Cayley numbers as in the proof 
of Proposition fTTJl View R 8 = R(l, i, j, k, e, ie, je, ke) and R 7 = R(i, j, k, e,ie, je, ke) . Let 
G = Spin(7), V = R 7 © R 7 © R 8 . The action of G on V is given by (A, B, B) ^ (A, A, B). 
The isotropy of G at p = (i,j, 1) G V is 

H = {(A, A, A) G Spin(8) : A G Sp(2), A fixes 1} = Sp(l), 

where we regard Sp(2) as the subgroup of SO (8) defined by the complex structures in R 8 
given by the left multiplications by the elements i, j. This identifies R 8 = H(l, e). 

The description of H shows that the cohomogeneity of (G, V) is 4 and the fixed point 
subspace 

V H = R(i,j,k) @R(i,j,k) @R{l,i,j,k) = R 10 . 
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It follows from Theorem El that dimiV = 6. The normalizer N of H in G is the same as the 
stabilizer of V in G. Suppose that (A, B, B) G N. Then we can write 

where Ai, A 2 G SO(4), Ai(l) = 1, and we view R 4 = R(l,i,j, fc). Since Sp(l) x Sp(l) -> 
SO(4), (p,q) i— > / p r ? (notation as in Lemma HJ) is a double covering, we can write A 2 = l p rq 
for unique (p, g) modulo ±1. Similarly, Sp(l) — > SO(3) , s h- > l s r s is a double covering, so we 
can write A\ = l s r s for a unique s modulo ±1. We deduce that (compare |CR98j . section 2) 

Therefore iV consists of the elements of the form (JIJ for p, g, s G Sp(l), and if consists of 
the elements with q = s = 1. Now 

N = N/H = Sp(l) x Z2 Sp(l) = {(g, s) G Sp(l) x Sp(l) : (g, s) ~ (-g, -s)}, 

the action of N on y H is given by 

(q,s) eN^ (l.r s ,l a r s ,l a r q ) G SO(3) x SO(3) x SO(4), 

and thus it is orbit equivalent to the product of the standard action of SO(3) on R 3 © R 3 
by the standard action of Sp(l) on C 2 . Since these are taut representations, we deduce that 
(N, V H ) is also taut. Now let L be the Z 2 -subgroup of H generated by the element (0) with 
q = s = 1, p = —1. Then V L = V . It follows from Proposition El that (G, V) is taut. □ 

Proposition 12. R 7 © R 8 © R 8 is not taut. 

Proof. We use a method similar to that of the proof of Proposition ITTI Let G = Spin(7), 
V = R 7 © R 8 © R 8 . The action of G on V is given by (A, B, B) ^ (A, B, B). The isotropy 
of G at p = (i, G V is 

H = {(A, A, A) G Spin(8) : A G SU(4), A fixes 1, j} ^ SU(2), 

and the cohomogeneity of (G, V) is 5. The fixed point subspace 

V H = R(i,j, k) © R(l, i,j, k) © R(l, i,j, k) = R 11 , 

and dimiV = 6. Now N, H and N are as in Proposition ITTI and the action of N on V H is 
given by 

(q,s) G N h-> (l s r s ,l s rg,l s rg) G SO(3) x SO(4) x SO(4). 

Let M = Gp, and let h denote the height function defined by p on M. It is not difficult 
to see that the critical set of the restriction h\M D coincides with the critical set of h 
(compare Lemma 3.17 in |GT| ). But Mfl V H = Np, and a tedious computation shows that 
the sum of the Betti numbers of the critical set of h\Np is 12. If M was taut, it would have 
to have the homology of S 5 x S 6 x S 7 by Proposition ^ so the sum of its Betti numbers 
would have to be 8. It follows that M is not taut. □ 
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3.7. G = Spin(8). By the discussion in section 13.11 the admissible summands of p are 
the vector representation which we denote by Rq, and the half-spin representations, which 
we denote by R+ and R 8 . The group of automorphisms of Spin(8) is isomorphic to the 
dihedral group of degree 3, and it permutes the representations R 8 , R 8 , R 8 , so this reduces 
the number of cases to be considered. We now note that Rq©R 8 is taut because the principal 
orbits are products of spheres; up to permutations, there are no other representations with 
two summands which need to be considered. Similarly, in the case of three summands, there 
are only two cases to be considered, see Propositions^JandEJ I n the case of four summands, 
at least two of them coincide, and we can assume that those are Rq. So there are three cases 
to be considered: Rq © Rq © R 8 © R+, R 8 © R 8 , © R 8 © R 8 , and R 8 © R 8 , © R 8 , © R+; the 
first one of these is not taut since a slice representation contains (Spin(7), R 7 © R 8 © R 8 ), 
which is not taut, and we can apply Proposition the second one is not taut because it 
contains (Spin(8), Rq © R+ © R 8 .), which is not taut by Proposition H3J and the third one is 
taut by Proposition E3 In the case of five summands, there is always a slice representation 
equivalent to (G 2 , R 7 © R 7 © R 7 ), which is not taut, and we can apply Proposition El 

Proposition 13. Rq © Rq © R+ is taut. 

Proof. We use a method similar to that of the proof of Proposition ITTI Let G = Spin(8), 
V = R 8 © R 8 © R s + . The action of G on V is given by (A, B, C) i-> (A, A, B). The isotropy 
of G at p = 1) G V is 

H = {(A, A, A) G Spin(8) : A G SU(4) fixes 1} = SU(3), 

and the cohomogeneity of (G, V) is 4. The fixed point subspace 

V H = R(l, i) © R(l, i) © R(l, i) R 6 , 

and dimiV = 2. We now construct two one-parameter subgroups of N which do not lie in H. 
Let A G SO(8) be the rotation by 9 on the plane R(l,z) fixing its orthogonal complement, 
and let B(x) = e^x, C(x) = xe^ , for x G Ca. Then (A,B,C) G N. We denote this 
transformation by t$. Next, let A G SO(8) fix 1, i, and let B G SU(4) act on C(l,j,e,ke) 
by the matrix diag(e lI/P , e~ lip , 1, 1). Then (A,B,B) G N. We denote this transformation by 
Sp. Now 

N Q = N°/H9*S 1 xS 1 = {(t 9 ,s v )}, 
and the action of N° on V H is given by 

(te,s v ) G N° t— > (e w ,e w ,e 1 ^) G U(l) x U(l) x U(l). 

This action is clearly taut. Let L be the subgroup of H generated by the diagonal matrices 
with ±1 entries. Then V L = V H , and (G, V) is taut by Proposition El □ 

Proposition 14. Rq © R 8 © R 8 is not taut. 

Proof. Here the action of G on V is given by (A, B, C) \— > (A, B, C). The isotropy of G at 
p = (1, G V is 

H = {(A, A, A) G Spin(8) : A G SU(4) fixes 1} £ SU(3), 

and the cohomogeneity of (G, V) is 4. The fixed point subspace V H and N° are as in 
Proposition El and the action of N° on V H is given by 

(t e ,8 v ) G N° I— > (e 4e ,e i( i + ^,e i( i-^) G U(l) x U(l) x U(l). 
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Since this action is equivalent to that of Lemmata), it is not taut. It follows that (G, V) 
is not taut by the final argument in the proof of Lemma 6.11 in |GT03j . □ 

Proposition 15. R 8 , © R 8 , © R 8 , © R 8 is taut. 

Proof. Here the action of G on V is given by (A, B, C) i— ► (A, A, A, B). The isotropy of G 
at p — (1, i, j, 1) G V is the same H as in Proposition ITT1 the cohomogeneity is 7, the fixed 
point subspace 

V H = R(l, i, j, k) © R(l, i, j, k) © R(l, i, j, fc) © R(l, i, j, k) = R 16 , 
and so dimiV = 9. As in Proposition ITTt we compute that 

M(('nU<('o%°,M'o rr £))—<wu}. 

and (JV, V H ) is 

(g,s,t) G iV h- (l s rt,l s rt,l s rt,l s r q ) G SO(4) x SO (4) x SO(4) x SO(4). 

This action is orbit equivalent to the product of (SO(4),R 4 © R 4 © R 4 ) and (Sp(l), C 2 ), 
hence, taut. We take L as in Proposition [TT] and we get that (G, V) is taut by Proposition El 
□ 



3.8. G=Spin(9). By the discussion in section |3~T1 the admissible summands of p are the 
vector representation on R and the spin representation on R . Note that R ©R ©R is 
not taut since a slice representation is (Spin(7), R 7 © R 8 © R 7 © R 8 ). The other possibilities 
are covered by the following two propositions. 



Proposition 16. R ib © R iD is taut. 

Proof. We need to have a good description of the spin representation of Spin(9). We 
start by letting {ei,...,e n } be the canonical basis of R™, and recalling that the Clifford 
algebra C£(n) (resp. C£ + (n)) is the real associative algebra with unit generated by ei, . . . , e n 
subject to the relations e^ej + = — 25y (resp. e^ej + e^i = +28^) . The group Spin(n) 
(resp. Spin + (n)) is the multiplicative subgroup of C£(n) (resp. C£ + (n)) consisting of even 
products of elements in the unit sphere of R n . It is clear that there is an isomorphism 
C£(n) © C — ► C£ + (n) © C, induced by h- > y/^lei, which restricts to an isomorphism 
Spin(n) — > Spin + (n) (see e.g. chapters 13 and 15 in |Pos86j ) . 

Now view 

R 9 = R © Ca, R 16 = Ca © Ca, 

where Ca = R(l, e, k, ei, ej, ek), and write {eo; e\, ■ ■ ■ , e$} for the basis {1; 1, ... , ek} of 
R 9 . Define 



<p : R 9 -»• M(16,R), (r,u) 



rig Ru 

Rn —rla 



where r G R, u G Ca, and R u : Ca — > Ca is right Cayley multiplication. Then ip(r,u) 2 = 
(r 2 + ||-u|| 2 )/ 16 . It follows that if induces a homomorphism C£ + (9) — > M(16,R). Restricting 
to Spin + (9) and identifying Spin(9) = Spin + (9), we finally get the spin representation 
A 9 : Spin(9) SO(16). 
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Now consider G = Spin(9) acting onV = R b © R b via A 9 
The principal isotropy subgroup H at the point ((1,0), (e, 1)) 
and Ag(H) consists of matrices of the form 



9 A 9 , where R 16 = CaffiCa. 
G V is isomorphic to SU(3), 



/ 1 



(2) 



\ 



A 

-B 



B 
A 



\ 



A 

-B 



B 
A 



e SO(16), 



/ 



where A + iB e SU(3). Now the cohomogeneity of (G, V) is 4, the fixed point subspace 

V H = R((l, 0), (e, 0), (0, 1), (0, e)> © R((l, 0), (e, 0), (0, 1), (0, e)> C R 16 © R 16 , 

and dimiV = 4. Using the above description of Ag, one can check that eoei, eie2, eoe2 belong 
to N and generate a subgroup isomorphic to SU(2). Moreover 636465666763 centralizes this 
subgroup and also belongs to N. Hence N° = U(2), and (N°,V H ) is (U(2),C 2 © C 2 ); 
this representation is taut by an argument similar to one used in the proof of Proposition 
based on the fact that the isotropy representation of the Grassmann manifold (^(C 2 ) is orbit 
equivalent to U(2) x U(2) acting on complex 2x2 matrices. Let L be the subgroup of H 
generated by the elements (J2J) with A diagonal with ±1 entries and B = 0. Then V L = V H . 
Thus, (G, V) is taut by Proposition □ 

Proposition 17. R 9 © R 16 is not taut. 

Proof. We use the description of the spin representation given in the proof of Proposi- 
tion^! One can check that the principal isotropy subgroup H at (e , (1, 1)) e R 9 ©(Ca©Ca) 
is isomorphic to G 2 , V H = R(e , e x ) © (Rl © Rl) C R 9 © (Ca © Ca), the cohomogeneity is 
3, and so dimiV = 1. It then follows that 9 1— > cos 6*1 + sin#(eoei) defines a one-parameter 
subgroup in N which acts on (Rl © Rl) as a rotation by an angle of 9, and acts on R(eo, ei) 
as a rotation by an ang le of 29. Therefore (N, V H ) is not taut. It follows that (G, V) is not 
taut by the final argument in the proof of Lemma 6.11 in [GT03]. □ 

3.9. G=Spin(10). By the discussion in section l3~Tl the admissible summands of p are the 
vector representation on R 10 , and the half-spin representations on C^ 6 and Ci 6 . It is clear 
that the following two propositions cover all possibilities. 

Proposition 18. R 10 © is not taut. 

Proof. We extend the ideas of Proposition [H3 Let C£°(n) denote the "even" part of C£(n), 
namely the subalgebra of C£(n) consisting of even products of elements in R ra . Then Spin(n) 
is a subgroup of C£°(n), and an isomorphism C£°(n) = C£(n — 1) is given by 



6j6j 



67.67-, 



6j6j , 



67 , 



if i < j < n, 
if % < n. 



View R = R 



Ca and R 

<p ± :R 9 
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Ca © Ca as in Proposition an d define 
M(16,C), (/•. //) r- ± v ! 



(r, u) I— >■ ±1 
13 



rig 

R,-, 



-rh 



where r G R, u G Ca, and R u : Ca — > Ca is right Cayley multiplication. Then <f±(r, u) 2 = 
— (r 2 + ||ti|| 2 )Ji6. It follows that ip± induce homomorphisms C£(9) — > M(16, C). Now 
Spin(lO) C C£°(10) = C£(9), so these homomorphisms restrict to the half-spin represen- 
tations A^ : Spin(lO) — > U(16). Note that u = e eie 2 e 3 e4e 5 eQe 7 eseg belongs to the center 
of Spin(lO) and Af (u) = ±\/—1Iiq. It follows that A^ and Aj" are not equivalent. It is 
also clear that A^ |Spin(9) = A 9 © A 9 . 

Next consider G = Spin(lO) acting on V = R 10 © C^ 6 . We view C^ 6 = R 16 © v^lR 16 , 
Spin(9)-invariant decomposition, where R 16 = Ca©Ca. A principal isotropy subgroup can 
be taken to be the same subgroup H as in Proposition [H3 and the fixed subspace 

V H = R(e , ei, e 2 , e 9 > © R((l, 0), (e, 0), (0, 1), (0, e)> 

©R((el, 0), (ee, 0), (0, el), (0, ee)) C R 10 © R 16 © eR 16 , 

where e = y/—l. Now the cohomogeneity of (G, V) is 5 and dim N = 7. 

It is not difficult to see that A is locally isomorphic to U(l) x SU(2) 1 x SU(2) 2 , where 
the U(l)-factor is generated by e^^e^Qejeg and the Lie algebras of the SU(2)-factors are 
respectively spanned by e ei + e 2 e 9 , e e 2 — eie 9 , e e 9 + eie 2 and e ei — e 2 e 9 , e e 2 + eie 9 , 
eoe 9 — eie 2 . We want to describe the action of A on V H . For that purpose, it is convenient 
to set R 4 = V H C]R W and C 4 = V H nC l £. Then it can be shown that there is a decomposition 
C 4 = C^ffiC 2 , such that SU(2) 1 x SU(2) 2 acts by the product of the standard representations 
on C\ © C 2 and it acts on R 4 by SU(2) 1 x SU(2) 2 -> SO(4). Moreover, U(l) acts scalarly 
on C 2 , C 2 , and trivially on R 4 . We finally get that (N°, V H ) is equivalent to 

(e> e ,p,q) G (U(l) x Sp(l) x Sp(l))/Z 2 ^ (l p r e - j9 ,l g r ej9 ,l p r q ) G SO(4) x SO(4) x SO(4), 

where we have identified V H = H © H © H. It is also important to note that iV is not 
connected, and the element e\e^e-je^ lies in iV \ A^°. 

Finally, consider the iV-orbit ofx= (1,1, 1) G H©H©H, and let h be the height function 
defined by x. A careful calculation shows that the sum of the Betti numbers of the critical 
set of h on A^a; is 12. Therefore, on Nx, this sum is at least 24. The critical set of h 
on Nx is the same as its critical set on M = Gx. If M is taut, it has the homology of 
S 15 x S 9 x S 7 x S 6 by Proposition so the sum of the Betti numbers of M has to be 16. 
Hence, M is not taut. □ 

Proposition 19. C+ © C+ 6 and C+ © C w are not taut. 

Proof. In both representations, the principal isotropy subgroup of the first summand 
acts on the second summand by a representation that contains a summand equivalent to 
(SU(4), C 4 © R 6 © R 6 © C 4 ), which is not taut. Hence we can apply Proposition [T] □ 

3.10. G=Spin(16). This case is ruled out because the spin representation on R 128 cannot 
be a summand of a taut representation of Spin(16) by the argument of Example ^i). 

Proof of Proposition^ Consider first the representation (Sp(n), V n ). Let K be Sp(l) x 
Sp(n — 1) diagonally embedded into Sp(n). Then there exists a point in V n whose isotropy 
subgroup is K, and such that its slice representation contains as a summand V n -\. This 
implies that V n @V n admits a slice representation containing V n _i © V n -\. By Proposition 
and induction on n, it is now enough to prove that (Sp(3), V 3 © V3) is not taut. 

The principal isotropy subgroup of (Sp(3), V3) is the diagonal embedding of Sp(l) 3 into 
Sp(3); call it K\. Now V3, considered as a representation of K\, decomposes into two 
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copies of the trivial representation and a representation W which, upon identification with 
H © H © H, is orbit equivalent to (notation as in Lemma 

(p,q,s) G Sp(l) 3 ^ (l p r q ,l p r s ,l q r s ) G SO(4) X SO(4) X SO(4). 

By Proposition [TJ it is enough to show that (Ki, W) is not taut, and, for that purpose, we 
will apply the reduction principle described in Proposition El to (Ki, W). 

The principal isotropy subgroup of (Ki, W) at the point G H©HffiH is the circle 

subgroup H = {(e kt , e kt , e~ kt ) : t G R} of K\. Therefore the cohomogeneity of {K\, W) is 4, 
the fixed point subspace of H is W H = R(l, k) © © R(i,j), and so the dimension of 

the normalizer N of H in K\ is 3. It is clear that N° = {(e ka , e kb , e kc ) : a, b, c G R}. Consider 
the one-parameter subgroups of N given by (f a = (e ka ,e~ ka , 1) and ipb = (l,e kb ,e kb ). Then 
Lp a and ip b generate N°, and (N°, V H ) is (ip a ,ip b ) i-> ( e ki2a - b \ e k(a+b) , e ki ~ a+2b) ), which is not 
taut by Lemmata). It follows that {K\, W) is not taut by the final argument in the proof 
of Lemma 6.11 in |GT03| . □ 
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